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Abstract — Higher Order Statistics are used in digital signal 
processing as a powerful analytical tool for the analysis of 
signals and systems. These statistics are very useful in problems 
where either non-Gaussianity or non-minimum phase. The 
computation of the fourth-order cross moments from incoming 
time-series data is an intensive process and requires parallel 
processing techniques and fast computing systems in order to 
follow the requirements of real-time processing. This paper 
presents an FPGA based design for high-speed computation of 
fourth-order cross moments. The proposed design is coded in 
VHDL and functionally verified by implementing it on Xilinx 
Virtex-5 FPGA. Simulations results are presented. The 
proposed design operates at a maximum frequency of 375 MHz. 


Index Terms — HOS, Cumulant 4, Correlation, parallel 
design, high speed computation, FPGA 


I. INTRODUCTION 

In the digital signal processing field, higher order statistics 
(HOS), especially the third and fourth order cumulants are 
commonly used. They have a wide applicability in many 
fields such as sonar, radar, seismic data processing, adaptive 
filtering, blind equalization, array processing, data 
communication, time-delay estimation, speech and image 
processing, texture analysis, pattern recognition, motion 
estimation and biomedical signal processing [Nikais 
93][Manolakos 91]. In this paper, the exploitation of these 
orders for communication systems is presented. 

In practice, Cumulants until order four are mostly used. 
However, for higher performance, the exploitation of a 
high-level hardware description language is the best solution. 
It is possible to use VHSIC Hardware Description Language 
(VHDL), Application Specific Integrated Circuit (ASIC) or 
Field Programmable Gate Array (FPGA). 

FPGA is a revolutionary device that combines a flexibility of 
both hardware and software. FPG As are very useful for 
operations that process large data streams, such as digital 
signal processing and networking. In comparison with the 
microprocessor-based designs, FPGA can be faster hundreds 
of times than microprocessor-based designs because it 
implements parallel spatial computations and simultaneously 
computing millions of operations in resources distributed 
across a silicon chip. The other benefit of FPGA is can be 
programmed and reprogrammed several times. In this paper, 
we present FPGA based design for the high speed 
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computation of fourth-order cross moments. Two designs are 
proposed; the first bases on an already completed correlation 
design, the second based on matrix multiplication algorithm 
[Alshebeili 01]. A comparison between the proposed design 
has been performed and the more efficient of them was been 
implemented. For both of designs, the computation of 
fourth-order crosses moments exploits intrinsic parallelism at 
technology FPGA. 

The remainder of the paper is organized as follows. A brief 
introduction to HOS and the simulation result in Matlab for 
the cumulant 4 are discussed in section 2.Two designs for the 
computation of fourth-order cross moments are described in 
section 3 and the architectural details for them have been 
discussed. FPGA implementation results for correlation are 
summarized in section 4. Finally, conclusion and prospects 
are given in section 5. 

II. Higher Order Statistics 

HOS is a technique for interpreting and analyzing the 
characteristics of a random process. HOS consists of 
higher-order moment spectra, which are defined for 
deterministic signals and Cumulant spectra, which are defined 
for random process. 

Contrary to second-order statistic, the HOS are well used due 
to their ability to maintain phase information and their 
robustness to additive Gaussian noise. HOS are 
multidimensional functions, then; the calculation complexity 
of HOS far exceeds that of conventional second-order 
statistics [Sakkila 09]. 

The characteristics of HOS are: suppression of Gaussian 
noise, reconstruction of the phase as well as magnitude 
response of signals and detection of the nonlinearities in the 
data [Sakkila 09]. 

An approach based on matrix multiplication for the 
computation of higher order cross moments was proposed in 
[Manzoor 07]. A series of matrix multiplication operations 
was formulates to compute the cross moments. A novel 
conception based on an approach of correlation is proposed. 

A. Fourth order Cumulant 

The fourth-order cross moment m 4 of a stationary random 
process x{n) with samples x 0 (n ), x { (n) , x 2 (n) and 
x 3 (n) is defined as [Nikais 93]: 

C 4 (r p r 2 ,r 3 ) = E{x Q {n)x x {n + T x )x 2 {n + r 2 )x 3 (n + r 3 )} (1) 

where, E{-} denotes statistical expectation and for 
deterministic signal, it is replaced by a time summation over 
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all time samples (for energy signals) or time averaging (for 
power signals). Under the assumption that x(jl) is of zero 
mean, the fourth-order moment is calculated from the given 
data as: 


| N -1 

C 4 (ij, r 2 , r 3 ) = — Y x 0 (n)x i (n + r, )x 2 (n + r 2 )x 3 (n + r 3 ) (2) 

Nti ' 

where, N is the length of each data record, /, = max {0, 
—T x , — T 2 , —T 3 }, and l 2 = min {N - 1, N —T x - 1, N—r 2 - 
1,N-T 3 -1} 


After several tests, the better combination for the proposed 
system is the product between “Signal, Reference, Signal, and 
Reference”, by varying the two last signal and Reference. 
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Fig. 2: Block diagram of parallel correlator 



Fig. 1: Cumulant vs. Correlation 


The result is given in figure 1. The noise has been clearly 
eliminated and the peak is thinner. Therefore, the use of 
Cumulant 4 in the field of radars is very useful to ensure good 
detection and for communication system it can be used to 
extract the useful signal. 

III. Proposed designs 
A. Design of correlator 

On every FPGA clock, 16 bytes (16 samples) of data are 
captured in parallel. These samples need first to be pipelined 
since they have to operate at the same clock speed as the 
incoming data. The results of the decoder then are passed 
back via a FIFO to the host application and can be read as 
valid received data. In this case, it is not possible to perform 
the series correlator; whilst the data is coming in parallel it 
will lose 15 bytes of data. So, a parallel correlator is required. 
The block diagram of implementation of the parallel 
correlator is shown in figure 2. 


<0$ qil) eO* c(!1l (ft ^!) <tf) cfli c^i aft c|i) <9 



The parallel correlator requires 16 sub-correlator. Every sub 
correlator contains multiplier and adder. The multiplier is 
needed to multiply the data input with the reference data, and 
adder is to sum the results of the multiplier. The basic 
principle of sub-correlator is shown in figure 3. 

B. First design of Cumulant 4 



Based on the parallel corelator, to accomplish the 
computation of the Cumulant 4, every sub block contains 
three multipliers. The first multiplier is needed to multiply the 
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data input with the shifted reference data, the second is 
required to multiply the shifted data input with the shifted 
reference data. The third is needed to multiply the results of 
the two first multipliers. An adder is necessary to sum the 
results of the third multiplier. The basic principle of this 
design is given in figure 4. 

C. Second design of Cumulant 4 

Let M. be a square matrix whose elements are samples of 
fourth-order cross moments defined in (3). 


Obtaining the fourth-order cross moments consist of 
computing the entries for matrix Mi for different values of i. 
These entries can be calculated by executing the matrix 
multiplication XYiZ. The block diagram for the computation 
of fourth-order cross moments is shown in figure 5. 



0 

0 


M. = XYZ 


(3) 



x(0) ... x(-V-^-l) 
x(l) ... XylN-q) 


Fig. 5: Block diagram of computation of cumulant 4 

The block diagram based on multiple multipliers MUL1 and 
MUL2. The first performs the multiplication of X by Yi and 
feeds the results to array MUL2. The second array MUL2 
multiplies XYi by Z. The 2D systolic array architecture is 
used as shown in Figures 6 and 7 for the matrix multiplication. 


0 x(0) 

m *(i) 
xfl) * t (2> 


.. x(.V-2) 

... x(.V-l) 
0 


.*(<?) *i(?+l) ... x(2?-l} x.Qq) ... 0 J (4) 


Where, X is a (2q + 1) x N rectangular matrix which is given 
by (4). Yi is an (2q + 1) x (2q +1) diagonal square matrix 
whose elements are given in (5). Z is an N x (2q + 1) 
rectangular matrix which is given by (6). Then, the 
computation of the cumulant 4 is equivalent to the 
computation of (2q +1) different matrices whose elements are 
obtained by multiplying three matrices as given in (3). 


x 0 (0).x 3 (i) 


x 0 (l).x 3 (l + i) 


Y,= 


0 


0 


(5) 


The systolic array is characterized by: simple and regular 
design, concurrent design and nearest neighbor 
communication [Manzoor 91]. FPGAs inherently possess the 
same regular structure, so they can be used efficiently to 
implement the proposed design. 

Multiplying the matrix X by the diagonal square matrix Yi is 
equivalent to multiplying the first diagonal element by the 
entries of first row of X, the second diagonal element by the 
entries of the second row of X and so on. 



x 0 (ri).x 3 (N - l + i) 


0 

0 

. x 2 (0) x 2 (l) ... x 2 {q) 

0 

x 2 (0) .. 

.* 2 (2?-l) 

I 2 (0) 

* 2 (1) . 

. x 2 (2q) 

* 2 (1) 
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( 6 ) 


Fig. 6: 2D systolic Architecture of MUL1 



Fig. 7: 2D systolic Architecture of MUL2 
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The systolic architectures for array MUL1 and MUL2 are 
showed in figures 2 and 3 respectively. It consists of sixteen 
identical Processing Elements (PEs). Each processing 
element contains Multiply Accumulate (MAC) unit and each 
MAC unit consists of a multiplier, adder, and a storage 
register. 

During each clock period, the function of each PE in MUL1 
array is to multiply the diagonal element of Y* [Y 11? Y 22 , Y 33 
Y44] by one element of matrix X. 

First column of the product XYi is produced by the first PE 
first as mentioned in the figure 6; second row generates the 
second column and so on. 

The MUL2 used the output of MUL1 that stored in an output 
buffer. Similarly, the final multiplication of (XYi) with Z is 
performed by MUL 2. 

As discussed for array MUL1, Z uses the same technique as 
the first array. The samples fourth-order cross moments are 
represent by the elements of matrix Mi. For N = 4, Mi is 
represented in matrix form as (7). 


m n 

m i2 

m i3 

m !4 


m 2 1 

m 22 

m 23 

m 24 


m 3 1 

m 32 

™33 

m 34 

(7) 

m 41 

m 42 

m 43 

m 44 _ 



The total number of PEs required for the computation of 
fourth-order cross moments is given by (8) 

P = N 2 + N 2 = IN 2 (8) 

IV. Simulation results 

The proposed design was coded in VHDL and realized in 
Xilinx Virtex-5 FPGA and the ADC S4/3G that has sampling 
speed rate up to 3 GSPS. 

In order to simulate the developed system in Xilinx ISE, it is 
needed to generate a data stimulus which is role as the 
incoming data. The easier way of generating of this data is by 
using the Matlab. Figure 8 shows an example of the data 
stimulus generated by Matlab. 


■ ISE Project Navigator (P.68d) - d:\lmaatougui\Bureau\Janvier Decembre 2016\FPGA\FPGA OK\Juste Correlateur\CorrelationOK_02\Correlatio... 
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dl5 <= ’ 
wait for 


01111111 *' 
10 ns; 


174 

dO 

<= " 

01111111"; 

175 

dl 

<= " 

01111111"; 

176 

d2 

<= " 

01111111"; 

177 

d3 

<= " 

01111111"; 

178 

d4 

<= " 

01111111"; 

179 

d5 

<= ** 

01111111"; 

180 

d6 

<= " 

01111111"; 

181 

d7 

<= " 

01111111"; 

182 

d8 

<= " 

11111111"; 

183 

d9 

<= " 

11100000"; 

184 

dlO 

<= 

"10110010" 

185 

dll 

<= 

"01111111" 

186 

dl2 

<= 

"01001100" 

187 

dl3 

<= 

"00011110" 

188 

dl4 

<= 

"00000000" 

189 

dl5 

<= 

"01111111" 

190 

wait for 

• 10 ns; 

191 

dO 

<= " 

01111111"; 

192 

dl 

<= " 

11111111"; 

193 

d2 

<= " 

11100000"; 

194 

d3 

<= " 

10110010"; 

195 

d4 

<= " 

01111111"; 

196 

d5 

<= " 

01001100"; 

197 

d6 

<= " 

00011110"; 

198 

d7 

<= " 

00000000"; 

199 

d8 

<= " 

01111111"; 

200 

d9 

<= " 

01111111"; 

201 

dlO 

<= 

"01111111" 

202 

dll 

<= 

"01111111" 

203 

dl2 

<= 

"01111111" 

204 

dl3 

<= 

"01111111" 

205 

dl4 

<= 

"01111111" 

206 

dl5 

<= 

"01111111" 


wait for 10 ns; 


"Win 
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Fig. 8: Example of the stimulus data 
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A. Correlation 



Fig. 9: Simulation of the parallel correlator. 


The figure 9 illustrates the results of the parallel 
correlator. It can be seen that there are 16 correlations is 
resulted on every FPGA clock cycle. 

A. Cumulant 4 


■ 8 additional MGT links to User FPGA 

■ High performance PCI and DMA controllers 

■ Local bus speeds of up to 80 MHz 

■ Two independent banks of 64Mx32 DDRII SDRAM 

(512 MB total) 

■ One bank of 2Mxl8 DDRII SSRAM (4 MB total) 


The comparison between the proposed designs of 
Cumulant 4 is underway and the more efficient will be 
simulated and then implemented in the FPGA card. 

B. Properties of FPGA card 

The ADM-XRC-5T1 is an FPGA card from Alpha-Data 
which has a high performance PCI Mezzanine Card (PMC) 
and designed for applications using Virtex-5 FPGAs from 
Xilinx. This card communicates with the computer using a 
PCI bridge developed by Alpha-Data which supports PCI-X 
and PCI. So, a high speed multiplexed address/data bus 
connects the computer to the FPGA. This card also uses a 
Primary XMC connector to provide high-speed serial 
connections. Figure 10 shows the physical board of 
ADM-XRC-5T1 card. 



The ADM-XRC-5T1 supports high performance PCI-X 
PCI operation without the need to integrate proprietary cores 
into the FPGA: 

■ Physically conformant to VITA 42 XMC Standard 

■ Physically conformant to IEEE P1386-2001 Common 

Mezzanine Card standard 

■ 8-lane PCIex / Serial Rapid IO connections to User 

FPGA 


V. CONCULSION AND PROSPECTS 

In this paper, an FPGA based design for computing the 
fourth-order cross moments is presented. The algorithm was 
implemented on Xilinx Virtex-5 FPGA and the ADC S4/3G 
that has sampling speed rate up to 3 GSPS. The maximum 
operating speed of the design as reported by the ISE tool is 
375 MHz. 

For efficient and high-speed computation of 
fourth-order cross moments under real-time constraints, the 
employment of FPGA technology has proven to be an 
attractive alternative. 

For further developer, this is an interesting challenge to 
develop under FPGA. 
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